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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1 ,1 14, and the fee set forth in 37 CFR 1 .17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on June 21, 2005 has been entered. 

Response to Amendment and Arguments 

2. Applicant's amendment filed on June 21, 2005 has been entered and made of record. 

3. Applicant's arguments, see pages 7-11, with respect to the rejection(s) of claim(s) 1-23, 
27-35, 43, 44 are persuasive. Therefore, the rejection has been withdrawn. However, upon 
further consideration, a new ground(s) of rejection is made in view of Kawabata, U.S. Patent No. 
6,370,262 ("Kawabata"), the details of which are provided below. 

Claim Rejections - 35 USC § 112 
The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 
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4. Claim 23 is rejected under 35 U.S.C. 1 12, second paragraph, as being indefinite for 
failing to particularly point out and distinctly claim the subject matter which applicant regards as 
the invention. 

Referring to claim 23, the phrase "each 2D image" in lines 2-3, renders the claim 
indefinite because it implies that are multiple 2D images, but there is no antecedent basis to 
support more than one 2D image. For example, claim 1 recites, "a 2D image," which indicates 
that there is only one 2D image. Appropriate correction is required. 

Claim Rejections - 35 USC §102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

5; Claims 1-3, 13-14, 27, 32, 33, 43-44 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Kawabata, U.S. Patent No. 6,370,262 ("Kawabata"). 

1. Referring to claim 1, Kawabata discloses a method of producing a depth map comprising 
the steps of: 

a. identifying at least one object within a 2D image (col. 6, lines 19-21 and figure 

2A); 



Application/Control Number: 09/586,869 Page 4 

Art Unit: 2623 

b. allocating an identifying tag (address) to the at least one object (col. 6, lines 48- 

53); 

c. allocating a depth tag to the at least one object (col. 6, lines 21-24 and figure 2B); 

d. determining and defining an outline (contour) of the at least one object (col. 6, 
lines 40-48); and 

e. encoding the identifying tag, the depth tag and the outline, of the at least one 
object to produce a depth map (col. 6, lines 19-53. Note that the depth map in figure 2C is 
produced based on the encoding of the identifying tag, depth tag, and outline of the object). 

Referring to claim 2, Kawabata further discloses that the object outline is defined by a 
series of co-ordinates (col. 6, lines 44-48). 

Referring to claim 3, Kawabata further discloses that the identifying tag is a unique 
number (col. 6, lines 48-53). 

Referring to claim 13, Kawabata further discloses that the depth tag is a numerical value 
(figure 2B). 

Referring to claim 14, Kawabata further discloses that the numerical value ranges from 0 
to 255 (col 6, lines 21-24 and figure 2B). 

Referring to claim 27, Kawabata discloses a method of encoding a depth map including: 

a. allocating an object identifier (address) to an object (col. 6, lines 48-53); 

b. allocating a depth tag to the object (col. 6, lines 21-24 and figure 2B); 

c. defining an outline (contour) of the object (col. 6, lines 40-48); and 
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d. producing a depth map by encoding the depth tag and the outline of the object 
(col. 6, lines 19-53. Note that the depth map in figure 2C is produced based on the encoding of 
the depth tag, and outline of the object). 

Referring to claim 32, Kawabata further discloses that the object outline is defined by at 
least one geometric shape (figure 2C). 

Referring to claim 33, Kawabata further discloses that the geometric shape is defined by 
the form of the shape and the parameters of the shape (col. 6, lines 3 1-53). 

Referring to claim 43, Kawabata further discloses a method of converting 2D images into 
stereoscopic images applying a depth map generated above (claim 1) [col. 5, lines 8-15, col. 6, 
lines 18-64]. 

Referring to claim 44, further discloses a method of converting 2D images into 
stereoscopic images applying a depth map generated above (claim 27) [col, 5, lines 8-15, col. 6, 
lines 18-64]. 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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6. Claim 5 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of 
Kawabata, U.S. Patent No. 6,370,262 ("Kawabata") and Matsugu et al., U.S. Patent No. 
6,167,167 ("Matsugu"). 

Referring to claim 5, Kawabata does not explicitly disclose that the step of determining 
the outline further includes tracing the at least one object pixel by pixel. However, this feature 
was exceedingly well known in the art. For example, Matsugu discloses the step of determining 
an outline of an object by tracing the object pixel by pixel (col. 15, line 35-col. 16, line 61). 

Kawabata and Matsugu are combinable because they are both concerned with image 
processing methods that determine the outline of an object. At the time of the invention, it 
would have been obvious to a person of ordinary skill in the art to modify Kawabata' s outline 
determining step in view of Matsugu. The suggestion/motivation for doing so would have been 
enhance the accuracy of the outline detection process (Matsugu, col. 3, line 4-6). Therefore, it 
would have been obvious to combine Kawabata with Matsugu to obtain the invention as 
specified in claim 5. 

7. Claims 6-10, 28-3 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Kawabata, U.S. Patent No. 6,370,262 ("Kawabata") and Meek et al. U.S. Patent 
No. 6,029,173 ("Meek"). 

Referring to claims 6-8, Kawabata does not explicitly disclose that the step of 
determining the outline further includes using straight lines, curve approximations, or Bezier 
curves to approximate the outline of the at least one object. However, this feature was 
exceedingly well known in the art. For example, Meek discloses a step of determining an outline 
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further that includes using straight line, curve, and Bezier curve approximations to approximate 
the outline of the at least one object (column 6, line 20-30). It would have been obvious to one 
of ordinary skill in the art at the time the invention was made to use straight line, curve, and 
Bezier curve approximations to approximate an outline as taught by Meek in order to minimize 
the storage requirements while providing a high level of accuracy in the representation of other- 
than- straight (curved) features (Meek, column 4, line 32-46). 

Referring to claim 9, Kawabata does not explicitly disclose that the step of determining 
the outline further includes comparing the object with a library of curves and/or generic 
geometric shapes to approximate the outline. However, this feature was exceedingly well known 
in the art. For example, Meek discloses a method and system for representation and use of shape 
information in geographic databases wherein a step of determining an outline (shape) includes 
comparing (matching) the object with a library of curves (column 8, line 50-64) and/or generic or 
geometric shapes to approximate the outline (column 6, line 14-30; column 8, line 20-48). It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
compare the object with a library of curves and/or generic geometric shapes as taught by Meek in 
order to approximate the outline and minimize the storage requirements while providing a high 
level of accuracy in the representation of other-than-straight (curved) features (Meek, column 4, 
line 32-46). 

Referring to claim 10, Meek further discloses that the curve and/or generic or geometric 
shape are scaled to best fit the object (column 8, line 50-64). 

Referring to claim 28, Kawabata does not explicitly disclose that the object outline is 
defined by a series of x, y coordinates, each x, y coordinate being separated by a curve. 
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However, this feature was exceedingly well known in the art. For example, Meek discloses an 
object outline that is defined by a series of x, y coordinates, each x, y coordinate being separated 
by a curve (figure 5). Therefore, it would have been obvious to combine Kawabata and Meek, 
for the reasons stated above. 

Referring to claim 29, Meek discloses further that each curve (other-than-straight 
segment) is stored in a library and allocated a unique numerical number (index reference value; 
column 8, line 60-64). 

Referring to claim 30, Meek further discloses that said object outline also includes data 
on the orientation (rotation) of each curve (column 8, line 50-64). 

Referring to claim 31, Meek discloses that each said curve is a Bezier curve (column 6, 
line 14-30). 

8. Claims 1 1-12 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Kawabata, U.S. Patent No. 6,370,262 ("Kawabata") and Nourbakhsh et al., U.S. 
Patent No. 5,793,900 ("Nourbakhsh."). 

Referring to claims 11-12, Kawabata does not disclose that the depth tag includes a color 
code, wherein white represents one of objects relatively close to the viewer, or objects relatively 
distant from the viewer and black represents the other. However, this feature was exceedingly 
well known in the art. For example, Nourbakhsh discloses generating categorical depth maps 

9 

using passive defocus sensing wherein a depth map is an array of categorical depth values, each 
value indicating the depth of the scene for a given region such that depth values of 2, 1, and 0 
correspond to close, medium, and far, respectively (column 5, line 9-15). Nourbakhsh further 



Application/Control Number: 09/586,869 Page 9 

Art Unit: 2623 

discloses that close regions are lightly shaded, medium regions are medium shaded, and far 
regions are darkly shaded (Figures 2-7; column 5, line 20-25), It would have been obvious to 
one of ordinary skill in the art at the time the invention was made to represent objects relatively 
close to the viewer as white, and objects relatively distant from the viewer with black as taught 
by Nourbakhsh in order to give the viewer an impression of depth using varying pixel intensities 
since a brighter portion logically indicates a closer portion which is easier to see, and a darker 
portion indicates a distant portion which is more difficult to see (Nourbakhsh, column 5, line 20- 
31). 

9. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Kawabata, U.S. Patent No. 6,370,262 ("Kawabata") and Eleftheriadis et al., U.S. Patent No. 
6,055,330 ("Eleftheriadis"). 

Referring to claim 18, Kawabata does not explicitly disclose the step of tracking the at 
least one object on successive frames of the image, and determining and assigning depth tags for 
the at least one object in each respective frame. However, this feature was exceedingly well 
known in the art. For example, Eleftheriadis discloses the step of tracking at least one object on 
successive frames of an image, and determining and assigning depth tags for the at least one 
object in each respective frame (column 18, line 45-55. Eleftheriadis explains that the "objects 
are adequately tracked" on successive frames). 

Kawabata and Eleftheriadis are combinable because they are both concerned with image 
processing systems for producing depth maps. At the time of the invention, it would have been 
obvious to a person of ordinary skill in the art to modify the method of Kawabata in view of 
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Eleftheriadis. The suggestion/motivation for doing so would have been to enhance the flexibility 
of the system. Therefore, it would have been obvious to combine Kawabata with Eleftheriadis to 
obtain the invention as specified in claim 18. 

10. Claims 23 is rejected under 35 U.S.C 103(a) as being unpatentable over Kawabata, U.S. 
Patent No. 6,370,262 ("Kawabata"). 

Referring to claim 23, Kawabata does not explicitly disclose the step of producing 
grayscale images that are at a lower resolution than the 2D image. However, Official notice is 
taken that producing images at a lower resolution was exceedingly well known in the art. 
Therefore, it would have been obvious to modify Kawabata' s method to include the step of 
producing grayscale images that are at a lower resolution than the 2D image in order to enhance 
the efficiency of the image storage/transmission process. 

Allowable Subject Matter 

1 1 . Claims 4, 19-22, 34-35 are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the base 
claim and any intervening claims. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Charles Kim whose telephone number is 571-272-7421. The 
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examiner can normally be reached on Mon thru Thurs 8:30am to 6pm and alternating Fri 9:30am 
to 6pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on 571-272-7429. The fax phone number for the 
organization where this application or proceeding is assigned is 571-272-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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